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^ ■ Abstract 

In his famous paper [7] Gersho stressed that the codeceUs of optimal 
quantizers asymptoticahy make an equal contribution to the distortion of 
•^r ■ the quantizer. Motivated by this fact, we investigate in this paper quan- 

[j , ' tizers in the scalar case, where each codecell contributes with exactly the 

same portion to the quantization error. We will show that such quantiz- 
ers of Gersho type - or Gersho quantizers for short - exist for non-atomic 
C^ ' scalar distributions. As a main result we will prove that Gersho quantizers 

are asymptotically optimal. 
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^^ 1 Introduction and notation 

O 

^SJ ■ Let /J, be a Borel probability measure on R''. A measurable mapping g : R"* — ?► M'' 

is called quantizer if card((7(R'^)) < card(N), where card denotes cardinality. For 
any quantizer g, norm || • || and norm exponent r > we define the distortion 
or quantization error 

rN ^ 
a. D{p.,q,r)= \\x-q{x)\\''dfi{x)^ ^ / ||a; - a|rd^(a;), 

where g~^(a) is called codecell of the codepoint a G g(R''). The set q(R.'^) is 
called codebook. The quantization error can be interpreted as a measure for the 
distance between /i and the image /xog~^ of /i under q. Indeed, if R'' is equipped 
with the Euclidean norm and if /i is vanishing on continuously differentiable 
{d — l)-dimensional submanifolds of R"*, then the quantization error equals the 
L,,— Wasserstein distance (see e.g. [T51 Theorem 2.6]). Let us denote the set of 
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all quantizers on R*^ by Q. For n G N we define the optimal n— th quantization 
error for /i of order r as 

Dn,ritJ-) = mi{D{fi,q,r) : g G Q and card(q(R'')) < n}. 

The problem of optimal quantization is to find an optimal n— level quantizer 
for /I, i.e. a g G Q with D(/i,g,r) = Dn^rilJ-)- Although an optimal quantizer 
exists under weak assumptions on /i (of. [TUl Theorem 4.12]), the determination 
of the optimal quantizers has been achieved so far only for a few distributions 
(see e.g. [lOj p.69fF], [6], [13], [H]). As another difficulty, often more than 
one optimal quantizer exists. This phenomenon of non- uniqueness can happen 
for distributions which are absolutely continuous with respect to the Lebesgue 
measure (cf. [Ij resp. [lOi Example 5.2]) but also for distributions which are 
singular pilTi]. 

Due to these difficulties and also in view of aspects in applications (see [I2ll8] 
for an excellent overview) , one is more interested in asymptotics of the optimal 
quantization error for large quantization levels n. For distributions which have 
a non-vanishing part that is absolutely continuous with respect to the Lebesgue 
measure and which are satisfying a certain moment condition, these asymptotics 
are well-known |23[ [51[TU ] . Now n- level quantizers are of interest, which induce 
the same error asymptotics as the optimal ones if n tends to infinity. Such a 
sequence of quantizers is called asymptotically optimal. 

Delattre et.al. [5] have shown for a large class of scalar distributions, that 
for any sequence of asymptotically optimal quantizers, which in addition satisfy 
a condition of stationarity, the codecells contribute asymptotically with equal 
portion to the distortion of the quantizer. This behavior was first mentioned 
by Panter and Dite [19j for optimal scalar quantizers under high rates. Toth 
[2T| and Gersho ^ conjectured this asymptotical behavior of optimal quantizers 
also for higher-dimensional distributions. 

These facts motivate us to investigate the following approach. Consider 
quantizers where each codecell contributes with exactly the same portion to the 
quantization error. In the following section we will show that such quantizers 
of Gersho type - or Gersho quantizers for short - exist for non-atomic scalar 
distributions and all levels n. Moreover, we will show that Gersho quantizers 
are even unique for all levels n if /i has an interval as support. 

Then, one can ask if such Gersho quantizers are asymptotically optimal. As 
a main result of this paper we will give in section three a positive answer to this 
question for a large class of scalar probability distributions (cf. Theorem IS.lOp . 
In the last section we provide concluding remarks which are mainly consisting 
of several remaining open questions. 

For the rest of this paper let us assume that fi is one-dimensional and non- 
atomic, i.e. fi{{x}) — ioi every a; G M. Moreover, we assume throughout the 
paper that fi has a finite r— th moment. For any Borel-measurable A C M with 
fJ,{A) > we denote by /i(-|^) the conditional probability of /i with respect to 
A. We denote by C{n, fi, r) the set of all n— optimal quantizers for /i of order r. 

Definition 1.1. We call q E Q an n— level Gersho- quantizer of order r for fi if 
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(Gl) card(g(R)) = n, 

(G2) q^^{a) is an interval for every a G <z(M), 

(G3) for every a G (/(R) the mapping M. 3 x ^ a is an element of 
C{1, ^{■\q^^{a)),r) and 

(G4) "-/q-i(a) \x-aYd^.{x) = D{fi,q,r) for every a £ q{M.). 

Let us denote by Q{n,fi,r) the set of all n~level Gersho-quantizers of order r 
for ^i. 

Remark 1.2. Because /i is non-atomic, we know that D{iJ,,q,r) > for any 
q G G{n,^,r). Gonsequently, property (G4) implies that ^{q~^{a)) > for 
every a G q{R), i-e. all codecells have non-vanishing ^—mass and, therefore, 
^{■\q^^{a)) in (G3) is well defined. 

Remark 1.3. Let q G C{n,fi,r) be an n— optimal quantizer. Lf we consider the 
codebook q(R) and a Voronoi partition {Aa : a G ^(R)} of M with respect to 
q{R), I.e. 

^a C {x G R : la; — al = min \x — 61} /i — a.s. for every a G ^(R), 

b£q{R) 

then the quantizer R 3 x — > a G (7(R), if x G Aa is also an n^ optimal one (cf. 
J1(A Lemma 3.1]). Due to this fact, the determination of optimal quantizers is 
reducing to the determination of an optimal set of n— centers, where the codecells 
are specified by an arbitrary Voronoi partition related to this set. Let us call 
such quantizers Voronoi quantizers. Insofar we can and will assume w.l.o.g. 
that every n— optimal quantizer is a Voronoi quantizer and satisfies (Gl), (G2) 
and (G3), see e.g. \1(A Lemma 3.1] and \1(A Theorem 4-1]- Gersho quantizers 
and optimal quantizers even coincide for some distributions. E.g. if fx is the 
uniform distribution on [0, 1], then it follows straightforward from property (G4) 
and \1C^ Example 5.2] that Q{n, /i, r) = C{n, /i, r) for every n G N and r > 1. Ln 
general, this is not the case. Even 

Q{n,fi,r) nC{n,^,r) = 

and 

DnAp) < inf{£'(M, g,?') : q e Q{n,^,r)} 

for certain distributions fi, quantization levels n and norm exponent r is possible, 
see e.g. fi as from /i/ resp. [10, Example 5.2] with n — 2 and r = 2. It remains 
open to characterize the Gersho quantizers which are Voronoi quantizers. 

2 Existence and uniqueness of Gersho-quantizers 

As already mentioned in the introduction, optimal quantizers exist under weak 
assumptions on ^, see [2], [20] and [ini Theorem 4.12]. In this section we will 
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show by Proposition l2.51 that Gersho quantizers also always exist for non-atomic 
distributions. Before studying uniqueness we need to make some limitations for 
Gersho quantizers. Let J-"(n, /z, r) be the set of all scalar quantizers where all 
codecells of such a quantizer have non- vanishing /i— mass and (Gl), (G2) and 
(G3) is satisfied. By definition and in view of Remark 11.31 resp. Remark 1 1.2 1 we 
know that 

G{n, fi, r) U C(n, fi, r) C J'(n, ^, r). 

Let q G F{n, /i, r) and let /i(q), . . . , /^(q) be the codecells of q such that 

inf(/i(g)) < inf(/2(q)) < • ■ • < inf(/„(<z)). (1) 

Let Oi = inf(/i(g)) and bi = sup(/i(g)) for every i G {1, ..,ri}. Clearly, 

ai = — oo, hn ~ oo and a^ = 5j_i for every i £ {2, .., n}. (2) 

Because // is non-atomic let us assume w.l.o.g. throughout this paper that 

Ii{q) = [ai,hi), Ii{q) = [ai.bi) for every i G {2, .., n}. 

Thus, q G J-{n,^,r) is completely characterized by the boundary points of 
its codecells. With these conventions we will also investigate in this section the 
uniqueness of Gersho quantizers. First, Proposition l2. 41 shows that every 7i-level 
Gersho-quantizer induces the same quantization error. Secondly, Proposition 
12.51 states card{Q{n,fi,r)) = 1 if the support of // is an (possibly unbounded) 
interval. 

For any — oo < a < 6 < oo we define lafi — (a, b). If ^{la.b) > and r > 1, 
then C{1, n{-\Ia.b),r) is not empty and consists of exactly one element (cf. \W[ 
Theorem 2.4]). We denote by Ca,b G M the point which represents this unique 
optimal quantizer of fi{-\Ia,b)i i-e. 

\X ~ CaMrd^i{-\Ia,b){x) = Di^r{K-\Ia,b))- (3) 

In view of [10( Lemma 2.6(a)] we additionally know that Ca,b G [a, b]- If we want 
to stress the dependency of Ca,b on ^ we write Ca,bifJ')- Let us denote by supp(/i) 
the support of /i. For any set / C M we denote by 1/ the indicator function of 
/. 

Lemma 2.1. Let — oo < a < 6 < oo and 

J = {a — b, oo) n (inf(supp(/i)),sup(supp(/i))). 
If fi{Ia,b) > and r > 1, then the mapping 



J 3 Z ^ Wa,b,f,{z) ^ \x-Ca,b+z\''dfJ,{x) (4) 

is continuous and increasing. Moreover, Wa.b,^iix) < VFa,fc,^(j/) for every x,y £ 
J with X < y and fi([x + b,y + b]) > 0. 
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Proof. Note that ir{Ia.b+z) > for every z E J. 

1. First we will show that J 9 z — ?> Ca.b+z is continuous. 

Let z E J. We proceed indirectly and assume that an M > and a sequence 
(£„)„gN exist with z + e„ G J for every n G N, e„ — ?■ as n — > oo and 

|Ca,&+z+e„ - Ca,b+z\ > M (5) 

for every n G N. Since the mapping R 9 w — > J^ |a; — w|'"d/i(z) is strictly 
convex (see proof of [lOl Theorem 2.4]) we deduce that 

Ci (M) := max{ / \x - w\'' dfi{x) : w e {ca,b+z - M, Ca.b+z + M}} 

= inf{/ \x-wrdii{x):\w-CaM+z\>M}. (6) 



Let 

C2(M) = Ci(M) - / la; - Ca,b+.rdAi(a;) > 0. 

Now choose no G N such that 

\x-Ca,b+zrdfl{x)- \x-Ca.b+zrdfl{x) <C2{M) (7) 



for every n > ng. Now let n > ng. Combining ([SJ and (O we observe that 

\X - Ca,b+z+sSd^J■{x) > \X- Ca,b+z+6„rdfJ-{x) > Ci{M). 



' Ia,b + z+e„ 

Using d?]) we get 



/ \x - CaM+z+eSd'^J.{x) 

•> Ia.b+z + E„ 



> C2{M)+ I \x-Ca,b+zrd^i{x) > \x-Ca,b+zrdfi{x), 

which contradicts the optimality of Ca,6+2+e„ • Hence, J 3 z ^ Ca,b+z is contin- 
uous. 

2. Rest of the proof. 

Let e > and z E J. For any S > we define 

Ci{S) ^ sup{|ca,h+«| : f G J, |w - z| < (5}. 

By step 1 we can find a (5i > such that C\(5\) < oo. For every v G J with 
Iz — w| < ^1 we have 

\x - Ca,b+v\'' < |a;r + Ci{SiY, 
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where the right hand side is /j,-integrable, because the r— th moment of /i is 
finite. Thus a. S2 G (0, Si) exists with 

\x ~ Ca,b+v\''dfJ.{x) < - (8) 

for every v £ J with |z — w| < 62- For every (53 G (0, (52) we define 

C2((53) = SUp{|Cq,6+z - Ca,6+„| : W G J, |w - Z | < (53} < oo. 

Applying step 1 we deduce that 

02(6) ^ as 6 ^ 0. (9) 

For any w G J with |w — zj < (53 and x G /a,b+z+(53 we define 

f{x,Z,v) = llx - Ca,b+z\'' - |x -Ca, h+„r|. (10) 

Clearly, 

f{x,Z,v) < i\x\ + \Ca,b+z\y + i\x\ + \Ca,b+z\ + C2((53))^ (H) 

Due to 02(33) < 00 the right hand side of (fTTj) is /i-integrable. From ([9]) and 
pU|) we deduce that f{x, z,v) ^- as v ^ z. Hence, by dominated convergence 
a (54 G (0, 5^) exists, such that 

f{x,z,v)dfi{x)<e/2, (12) 

if |i; — z| < 64. Now let ti G J such that jw — z| < 84. We obtain 

\Wa,bAz) ~ Wa.bAv)\ 
< \ \x-Ca,b+maxiv,z)\''dlJ,{x) 

F ~ Cq ;,_|_niax(-u,z) I "/i(a;)| 

o,6+mi„(^,^) 

k - Ca,6+max(tsz)rrfAi(2;) 

^) 

\X - Ca.b+-min{v,z)\''dfi{x)\ 

a.b+mm(„,^) 



< / |a;-CQ,6+max(i,.z)rc'M(a;) + / f (x, z, v)dfi{x) . 

J[b+z-Si.b+z+Si] Jla.b+z 

From (HI) and ^ we deduce that 
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which yields that the mapping is continuous. Finally we observe for any x,y € J 
with X < y that 

\z~ Ca,b+v\''dfi{z) - / \z- Ca.b+xrdfi{z) 

Ia,b+y -^ la.b+x 



> / \z-Ca,b+y^d^l{z)>0, (13) 

•^ ib + x,b+y 

which implies monotony. If fi{[x + b,y + b]) > 0, then (fT3|) is strict and thus the 
proof is finished. D 

Remark 2.2. Wa,6,/i(') is continuous and increasing. Therefore the set N of 
points where Wa,b,tJ.{-) is not differentiable has zero Lebesgue measure. It remains 
open to find sufficient conditions for fi .such that iV = 0. Because we do not 
need any information about the (non-) differentiability ofWa.b,p,{:) ''^ ^^i'^ paper, 
we do not investigate this issue. 

Because we want to show now that every n— level Gersho quantizer induces 
the same quantization error, the following definition makes sense. 

Definition 2.3. Let n G N and assume that Q{n,ii,r) ^ 0. We define 

Dn,M = inf{£'(A*, q,r) -.qe Q{n, /i, r)} 

as the optimal n—th Gersho- quantization error for fi of order r. 

Let 

K 9 x ^ T{x) = -X 

be the reflection with respect to the origin. 

Proposition 2.4. Let n E N and ?■ > 1. Assume that Q{n,^,r) ^ 0. // 
q G C/(n, \i,r), then 

D{ti,q,r)^Dg^ifi). 

Proof. If n = 1, then the assertion follows immediately from [10, Theorem 2.4]. 
Let n > 2. Let Ii{q), . . . , In{q) be the codecells of q such that ([T]) is satisfied. 
Moreover, let p G Q{n,fi,r) and denote by Ii{p), . . . ,In{p) the codecells of p 
such that dD) is satisfied, too. We proceed indirectly and assume w.l.o.g. that 

D{fi,q,r) < D{tx,p,r). (14) 

In order to derive a contradiction we divide the remaining part of the proof into 
two parts. 

1. We will show that 

supln-i{q) < supln-i{p) and ^([sup/„_i((7), sup/„_i(p)]) > 0. 
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We proceed by induction and assume first that n = 2. According to ([3]), (|14p 
and by (G4) we know tliat 

\x - C^oo.sup Ii{q)r dfi{x) < / \X~ C_oo,supli{p)rdfi{x) 

hiq) J hip) 

= W^oofi.fiisnp Ii{p)). 

Applying Lemma l2.ll we obtain sup/i(g) < sup/i(p). Moreover, definition ([3]) 
and (01) are yielding /x([sup/i(g),sup/i(p)]) > 0. Now let us assume that n > 2, 
sup/„-2(<7) < sup/„_2(p) and that /x([sup/„_2('7),sup/„_2(p)]) > 0. Again 
from (fT4|) and (G4) we deduce that 

W^inf7„_i(<}),0,M(sup/n-l('7)) 

\X - Cinl I„_i{q),sup Ir,-iiq)\'' dfJ-ix) 
A.-l(«) 



< / \X - Cin{I„_-,{p),supI„^iip)rdp{x) 

JU-l(p) 

= I \x-C_supIr,-iip}~infI^^i{p}{P°T~^)\''dpoT~^{x) 

Jt(/„_i(p)) 

= VF_sup7„_i(p)^0,MoT-i(-inf/n-l(p))- (15) 

By ^ we know that inf /„_i(g) = sup/„_2('?) < sup/„_2(p) = inf /„_i(p). 
Thus, Lemma [2.11 implies 

W^-sup/„_i(p),0,MoT-i(-illf/«-l(p)) < W^_sup/„_i(p),0,poT-i(-inf/n-l(<?)) 

= W/inf/„„i(g),0,p(sup/„_i(p)). (16) 

Combing p5|) and (jTB)) we get 

W^inf7„_i(g),0,M(sup/„^l((7)) < Wini I^_,{q),0,t^{^^P In-l{p)) ■ 

Now Lemma 12.11 yields sup/„_i(q) < sup/„_i(p). Finally, definition ([3]) and 
(HI) imply ^([sup/„_i((j),sup/„_i(p)]) > 0. 

2. Rest of the proof. 

Applying ([2]) and definition ((4]) we compute 

\X-Cin{l„{p).oo\'^dp,{x) = lV"_oo,0.poT-i(-SUp/„_i(p)). (17) 

iAp) 
Now, step 1, Lemma [13] and definition ^ implies 

W^-oo,0,,.oT-i(-SUp/„_i(p)) < W^-oo,0,MoT-i(-SUp/„_i((7)) 

\x-Cin{I,,{q),oc\''dp{x). (18) 
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From (dH) and (G4) we deduce 

k -Cinf /„(,). oo r' c?M(a;) < / \x-Cin{i„(p),oordii{x). (19) 

Combining (fT9|) . (fT8|) and (fT7| we get the contradiction 

which proves the assertion. D 

Now we can state and prove the main resuh of this section. 

Proposition 2.5. Let r > 1. For any n G N the set Q{n,fi,r) of Gersho- 
quantizers is not empty. Moreover, if the support of /i is an interval, then 
card(Cy(n, ^,r)) — 1. 

Proof. We proceed by induction. Assume first that n ~ 1. In this case the 
assertion follows directly from [lOl Theorem 2.4]. Now assume that for every 
z GT = {w &R: /i(/«,,oo) € (0,1)} the set Q{n— l,^{-\Iz,oa),r) is not empty 
and that card(Cy(n — l, /i(-|/2.oo), ?")) = 1 if the support of /i(-|/2^oo) is an interval. 
Let us consider the mapping 

$„_,(.) . ^(^-)^'^^f(-|^-)^. (20) 

We divide the remaining part of the proof into several steps. 

1. We construct quantizers qn,z and qn.z and show that g„^2 G Q{n^l, fJ-{-\Iz, oo), r). 
We define for every z £ T recursively 

woiz) ^ z, w„„i(z) = oo 

and 



Wi{z) = inf <w> Wi-i{z) : I \x ~ c^._^(^)^^y dii{x) = $„_i(z) \ . 

for every i e {l,...,n — 2}. Let pz G Q{n — 1, fi{-\Iz^oo),i") and denote by 
Iiipz), ■ ■ ■ ,In~i{Pz) the codecells of p^ such that ([Ij is satisfied. Note that 

^«-i,.(M-|^.,oo)) = D{fi{-\Iz,oo),Pz,r) 

according to Proposition 12.41 Thus we deduce by (G4) and I^U^ that 

^n-l{z) = / \X-Cz, sup h{p,)rdfj,{x). 

J[z,suph{p^)] 

Hence, the definition of wilz) implies ^1(2) < swp Ii(pz). Moreover, 

li{[wi{z),s\ipli{pz)]) = 0, 
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because otherwise we would get together with Lemma [^3] that 

J[z,wi(z)] 

< / \x-pz{x)\''dfi{x), 

J[z,supli{p^)] 

which would contradict Pz G Gin — 1, pi-\Iz, oo), f)- Hence we obtain inductively 
that 

p{[wi{z), sup liipz)]) = for every i G {l,..,n-2}, 

which implies together with (G3), (G4) and © that 

K^ ^Wn-2{z):Wn-i{z)\ Clp\X) 

[Wri-2{z),Wn-l{z)) 

\x-pz{x)\'^d^i{x)='^n-l{z)>Q. (21) 

From (|2T|) we know that p{[wn-2{z) , w„-i(z)]) > 0. Moreover, the definition of 
Wi and Lemma l2 . II implv for i G {1, . . . , n — 2} that 

\X - C^,_^(z),Wi(z)\''dlJ.{x) = ^n-i{z) > 0, (22) 

[wi^i{z),Wi{z)] 

which yields p{[wi-i{z) , Wi{z)]) > for every i G {1, . . . , n — 2}. Thus we can 
define for x G M the quantizers 

n-2 
qn,z{x) = C_oo,zl(_oo_2)(x) + 2_^ Ct„i(z),iui+i (z) l[u,i(z),u,i+i (z)) (a;) 

1=0 

and 

n-2 

Qn,z\X) — C_oo,«)i(z)-'-( — oo,toi(z)) V^^j i / ^ C^i(z),M>i+i (z) -*-[«;; (z),M>i+i (z)) V'*'/- 

1=1 

The definition of g„^2 and Qn.z imply together with (piT) and (P^ that 

gn,z G g{n- l,^i{-\Iz,oo),r). 

We will show that $„_i(-) is decreasing and continuous. 

2. We will show that $„_i(-) is decreasing. 

Let (5 > such that z + 5 < wi{z) and /^([^ + (5, wi(z)]) > 0. If p{[z,z + S]) — 0, 
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then definition ([20]) implies $„_i(z) = <J>„_i(z + 5). Hence we can assume 
w.l.o.g. that fi{[z, z + S]) > 0. Thus we get from Lemma [2?11 



$„_i(z) = / \x-c^_,^^(^)\''dfi{x) 

J[z,wi{z}] 



J[z+S,wi{z)] 

> / \x-c,+s,^m{z)rdfi{x)>0. (23) 

J [2+5,101(2)] 

Now let us assume that 

$„_i(z)<$„_i(z + (5). (24) 

In this case we obtain 



/ \x-c^+s,wi{z)rdtJ-{x) 

J[z+5,Wt{z+5)] 



> I \x - C^+S.wi{z+5)\''d^l{x) 

J[z+S,wi{z+S)] 

= $„_i(z + <5)>$„_i(z). (25) 



Combining (^5)) and (P5|) we get 

/ \x-c^+5,wi(z)\''dKx) > Ia;-c^+a,^i(^)rd^(x), 

Jfz+A.?!), fz+5~ll J\z+R.in,(z)] 



'[z+S,wi(z+5)] J[z+5,wi(z)] 



which implies that wi(z) < wi{z + S) and ^{[wi{z),'wi{z + S)]) > 0. Inductively 
one obtains that ^i{[wn-2{z), Wn-2{z + 5)]) > 0, yielding that 

$„_i(z + (5) = / \x-Cy,^_^(z+s),cordfi{x) 

•^ [«'n-2(2 + '5),Oo) 



•^ [«'n-2(z),00) 

which contradicts assumption ([M)) . Thus we have proved that $„_i(-) is de- 
creasing. 

3. We will show that $„_i(-) is continuous. 

Note that wi(-) is increasing. Indeed, Lemma \TJ\ and Step 2 yields 

/ \x-Cz,wiiz+s)\''dfJ-{x) = $„_i(z + (5) < $„_i(z) 

J [2,101(2+5)] 

= / |a;-C2,^i(z)rd^(a;) 

-'[2, 101(2)] 

< / k-c^,^i(^+5)rdM(a;), 

J [2,101(2)] 
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implying wilz + S) < wi{z). Hence, wi{-) is increasing and consequently we get 

<^n-l{z + S) ^ / \x~C^+S,n,i{z+S}\''dfJ.ix) 

J[z+S,wi{z+5)] 

> / \x-c^+s.wi{z)\''dfJ-ix), 

J[z+S,wi(z)] 

which implies 

< $„-i(z)-$„-i(z + <5) 

< / \x-c^,wi(z)\''d^J-{x) - \x-c^+s,wi{z)\''dfJ-{x) 

J[z,wi{z)] J [z+S,wi{z)] 

< / \x-c^+s,w,iz)\'^d^{x) ~ \x-c^+s,w,iz)\'^d^{x) 

J[z,wi{z)] J [z+5,wi{z)] 

< ^([z,z + (5])|z-wi(z)r. 

Because the right hand side tends to as (5 ^ we obtain that $„_i(-) is 
continuous. 

4. Rest of the proof. 

Now we consider the mapping 

^l{z) ^W-oo,0,p.{z) ^ / \x-C-oo,z{^J.)\'^d^l{x). 

J ( — 00,2) 



From Lemma 12.11 we know that ^i(-) is increasing and continuous. Moreover, 
lim2_j._oo ^i(^) = and limz^oo'^iiz) — -Di.r(/^) > 0. On the other hand we 
know from step 2 and 3 that $„_i(-) is decreasing and continuous. Moreover, 
lim^^-oo $n-i(-2) > and limz-^oa ^n-i{z) = 0. Hence a. zq £ T exists, such 
that $„_i(zo) — *i(2o)- It is easy to check that qn,zo G Qij^iP^ ■,'>')■ Finally, 
assume that the support of /x is an interval. By Lemma |2. II the mapping ^i(-) 
is strictly increasing in this case. Hence, exactly one zq G M exists, such that 
^ri-i(2o) — ^i(zo). Moreover, we know by assumption that 

card(5(n- l,^{-\I,^^,^ao),r)) = 1. 

From qn,zo £ Q{n — 1, /i(-|/z,oo), J') and by the definition of qn,zo we deduce, that 
9n,zo is the only optimal n— th Gersho quantizer for /x, i.e. card(5(n,/i, r)) — 1, 
which finishes the proof. D 

Remark 2.6. ///i is the uniform distribution on 

[-1, -1/2] U [1/2,1], 
then Q{2, fi,r) is not countable, because 

3 3 

1e{-) = -^ ■ l{-oo,-l/2+£)(-) + ^ • l[-l/2+e,oo)(-) 
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is a Gersho quantizer for every e € (0,1). Beside of this obvious example it 
remains open, if a non-atomic distribution /i exists, where card(t/(n,/i, r)) > 1 
for some n and r such that at least two different elements ofQ{n, /x, r) exist with 
different codebooks. Moreover, it remains open to characterize those non-atomic 
scalar distributions which satisfy card(t/(n, /i, r)) = 1. 

3 High-rate quantization of scalar distributions 
with Gersho-quantizers 

We denote by A the Lebesgue measure on R. As already mentioned in the 
introduction, the asymptotic behavior of optimal quantizers - even in higher 
dimensions - is well-known. For scalar distributions the following holds. Let 
A* = /ia + Ms be the Lebesgue decomposition of /i with respect to A, where 
Ha = ha\ with Lebesgue density ha- 

Theorem 3.1 ([23l[3j[T0]). Assume that fj,a does not vanish and that 

\x\''+^dn{x) < oo (26) 

for some 6 > 0. Then 

n'-DnAlj) -^ 2-'-(l + r)-i ( / h\l^^+''U\\ if n ^ oo. (27) 

Because we assume throughout this section that /i is absolutely continuous 
with respect to A, we make the following definition with h as the Lebesgue 
density of /x. Let g(r) = 2-''(l + r)-i. If / /ii/(i+'')dA < oo, then we define the 
constant 



Co = Q(r)(^y'/.V(i+^)dA) 



l+r 



Remark 3.2. Note that Cq < oo follows from h26]) by applying a Holder argu- 
ment, see \1(^ Remark 6.3(a)]. 



In view of (|27|) one is interested in quantizer sequences where the quantiza- 
tion error converges to Cq as the quantization level tends to infinity. To this 
end the following definition makes sense. 

Definition 3.3. Assume that Cq < oo. We call a sequence {qn)nefi of quantiz- 
ers asymptotically optimal i/ card((7„(R)) < n and 

n''D{p,qn,r) -;■ Cq 

for n — ?> oo. 
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Remark 3.4. Another definition of asymptotic optimality would be 

D{lJ.,qn,r 



Dn,M 



1 



as n -^ oo, which is equivalent to Definition \3.3\ if h2b]) is satisfied. Slightly 
different from other definitions (cf. \10[ p. 93]), we require in Definition US. 3\) 
only the finiteness of Cq, which is by fl(A Remark 6.3(b)] weaker than condition 
1126]) . Clearly, if {qn)neN ^^ asymptotically optimal, then D{fi,qn,r) -^ as 
n — > cxD. 

Now it is natural to ask if Gersho quantizers are asymptotically optimal. As 
a main result of this paper (cf. Theorem l3.10|) we will prove in this section, that 
the answer is positive at least for distributions with a so-called weakly unimodal 
density. 

Definition 3.5. We call a probability density function h weakly unimodal, if h 
is continuous on its support and there exists an Iq > such that {x : h{x) > 1} 
is a compact interval for every I € (0, Iq). 

Remark 3.6. Many scalar probability densities are weakly unimodal, e.g. the 
ones of Gaussian, Laplace or exponential distributions. Clearly, every distribu- 
tion ^ with a weakly unimodal density has an (possibly unbounded) interval as 
support. Hence, Provosition \2.5\ implies csiTd{Q{n, fi,r)) = 1 if r > 1. 



In the proof of Theorem l3. li the assertion is proved first for distributions with 
piecewise constant density. Then the general case is proved by an approximation 
argument. Unfortunately, we cannot use this technique for Gersho quantizers, 
because any amendments of the density will destroy property (G4) in general. 
Therefore, we use a different approach in this paper. We split the quantization 
error into the contribution of the codecells which are lying inside a compact 
interval and the contribution of the remaining ones. The asymptotic behavior 
inside the interval can be determined by using the uniform continuity of h on 
compact intervals. The number and the contribution to the error of the codecells 
which are outside the compact interval can be controlled by using (G4). 

Let — oo < u < v < oo and / = [u,w]. Assume that /i(/) > 0. For every 
n e N let 

ni{n) = card({c G <z„(R) : q-\c) C R\(m,i;)}). (28) 

Lemma 3.7. Let /i be weakly unimodal, r > 1 and {qn)neN the sequence of 
n-level Gersho quantizers for /i. Then, 

(a) 712(^ + 1) ^ Ti2{n) and 
Proof. First we will prove assertion (b). 
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If n = 1, then let Ii{q2) and I2{<i2) according to ((T|). Applying ^ and (G3) we 
calculate 



X — qi{x)\^ d^{x) 



\x ~ qi{x)\^dfi{x) + / \x — qi{x)\^ d^{x) 

(-oo,sup/i(g2)) •^[sup7i(ij2),oo) 



J Iliq-i) J I2(q2) 

= D{ti,q2,r)> D{ti,q2,r)/2. 

Now let n > 2. In this case we proceed indirectly and assume the contrary, i.e. 

we assume that 

D{p,qn,r) ^ D{fi,qn+i,r) 

n n+1 ' ^ ^ 

Now let gn(K) — {ci,...,c„} with — cxd < ci < • • ■ < c„ < oo. Moreover, 
let g„+i(R) = {di, . . . ,d„+i} with — oo < di < • • • < dn+i < cxd. Let i/i = 
supq'~^(ci) and zi = sup (7,7+1 (^^i)- From (p9)) we obtain together with (G4) 
that 



\x — cil"^ dfi{x) < / \x — di\^d^{x). 

(-00, yi) J(-oo,2i) 

Consequently, Lemma [2.11 implies together with (G3) that yi < zi. If n > 2, 
then we obtain inductively that 

supg,7^(c,) < supq~lj^{d,) < supgr^j;^(d,+i) (30) 

for every i e {l,..,n — 1}. On the other hand, applying again ([29)1 and (G4) we 
get 

/ \x — dn+i\^ dii{x) > / \x — Cn\^dfl{x). 

J(infg-ji(d„ + i),oo) J(miq-\c„),oo) 

Thus, ^ and Lemma O yields 

sup<7~+i(dn) = inf g.7J;^(d„+i) < inf g,7^(c„) = supq~^{cn-i), 

which contradicts (PU)) . Thus, assertion (b) is proved. 
Now we will prove assertion (a). 
For any n £ N we define 

77-2' (n) = card{c G <Zn(K) : supg^ (c) < min/} 

and 

n^'^^n) — card{c G (7ti(K) '■ inf g7^("^) — max/}. 
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If 17.2' (n) = 0, then we immediately obtain rij' (n) < ^2' (n + 1). Now let us 
assume that 71,2' (n) > 0. Let a — min<7„(IR) and b — mmqn+i{R). From (b) we 
obtain 



\x~a\^d^{x)> / \x — b\^d^(x). 

Applying ([2]) and (G3) we obtain from Lemma [2T1 that sup (7,7^ (a) > supq^^-^{b). 
Now let 

a' = max{c e (/nCHi) • supg,,7 (c) < min/} 

and 

b' = max{c G q„+i(M) : supg~+i(c) < min/}. 

Thus, using Lemma 12.11 again, we obtain by induction that supq~^(a') > 
aupq^^i{b'), which implies ^2' (n) < n^ {n + 1). By the same argumenta- 
tion we deduce that n2^(n) < n2^{n + 1). Assertion (b) follows now by the 
observation 712' (n) + n2^ {n) = n2{n) and the proof is finished. D 

For any n— level Gersho quantizer (/„ we define 

Jn.i — {a ^ <7n(IR) : In^io) C /} and n{{n) = card J^j. (31) 

Moreover, we denote by S{^) the interior of supp(/i) and define 

Tnj = [inf g;^^(min J„j),supg,7^(max J„j)] 
if Jn,i is nonempty. 

Lemma 3.8. Let r > 1. Let /i be weakly unimodal and {qn)neN the sequence 
of n— level Gersho quantizers for fj,. Assume that I C S{fi). Then an m G N 
exists, such that J„j is nonempty for every n > m. Let n > m and 



ei(n) 



•Iqr^ (a) 



a e Jn.I 



J^^^hyi^+^)dX ni{n) 
S2{n) — max{| / \x — a\^diJ,{x) — diam(g,7"'^(a))"'^^'^^(a)'9('')| : a G Jn /}, 

e3(n) = max{| / h^/'-^+^'^dX - dia.m{q-\a))h{ay^^'^+'-^\ : a e J„ i}. 

Jq^Ha) 

Then, 

diam(T„,/) -^ diam(/), (32) 

n{{n)£i{n) -^ 0, (33) 

(n[{n)f+-e2{n) -> 0, (34) 

n((n)e3(n) ^ 0, (35) 

as n —>■ 00. Moreover, 

limsup _, = 0. (36) 

n^oo min{diam((7„ (a)) : a G Jn,i} 
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Proof. Because fi is weakly unimodal and due to / C S{ii) we get 

< Mij := min{/i(a;) : x e 1} and (37) 

oo > M2J :~ inax{h{x) : x G /} > Mij. 

We divide the remaining proof into six steps. 

1. We will show that J„_/ is nonempty for every n > m. 

Note that 



D{fj.,qn,r) = X! /_i \x-a\''dfi{x) 

^ J2 f , |x-gi(x)rdM(x)=i^(M,(7i,r)<oo, (38) 

which implies 

D{fx,q„,r)/n^O (39) 

as n — ?► 00. If Jnj = 0, then a c G 9ri(K) exists, such that 

diam((j,;i(c) n/) > diam(/)/2 and <j,;^(c)\I 7^ 0. 
Recall / = [uju]. Hence, (G4) yields 

D{fj,,qn,r)/n> miii{ei, 62} > (40) 

with 

ei = / |a; - (-U + -u)|''d/x(x) 

J[«,(u+t;)/2] 4 4 

and 

f 13 

62 = / |x-(-u+-w)|''dAi(a;). 

J[{u+v)/2,v] 4 4 

Note, that the right hand side of pO|) is independent of n. Thus, we deduce 
from (|39|) and (|40)) that an to G N exists, such that Jnj is nonempty for all 
n > m. Let us assume w.l.o.g. for the rest of this proof that to = 1. 

2. We will prove (|32l) . 

We proceed indirectly and assume that a constant M G [0,diam(/)) and a sub- 
sequence of (diam(T„j))„gN exists, which we also denote by (diam(T„./))„gN, 
such that 

diam(r„./) -^ M as n -^ 00. (41) 

Let 

s„ = max{a G gn(M) : inf q^^(a) < min/}, 
i„ = min{a G (Zn(K) '■ supg^ (a) > max/}. 
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Let 

s = lim (supg^ (s„) — rami) and t = lini (max/ — ini q^ (tn))). 

Due to (|4T|) we know that s and t exist and that s + t = diam/ — M > 0. If we 
assume w.l.o.g. that s > 0, then we obtain 

hminf / \x — Sn\'^dfi{x) 



> hminf/ |x - s„|''Mi /dA(a;) 

> hminf/ |x - (supq~\s„) + min/)/2|''A/i /dA(x) 

"^°° Jinq-\s„) 

= hminf Q(r)Mi./(supg^i(s„) - min/)i+'^ = Q(r)Afi.7si+'^ > 0. (42) 
On the other hand we get from (G4) that 

hmsup / |x — s„|''d/i(x) = hmsup '—^ — . (43) 

n—^oo J q^^ (sn) n—^oo ^ 

Combining (j43|) and psp we obtain 

hmsup / \x — Sn\^dfi{x) = 0, 



which contradicts (|42|) . 

3. We will show that rig G N and constants A^, Bq E (0, oo) exist, such that 

max{diam((7~^(a)) : a £ Jn,i} < ^o("-i("'))^^ 

and 

min{diam((7~^(a)) : a G Jnj} > So("-i("-))~^ 

for every n > uq. 
Let a e J„j and 

Mij < M^j = m[n{h{x) : x e <7,7i(a)}, Afj,/ > MIj = max{/i(x) : x £ (7^^(a)}. 

Applying property (G3) of g„ we obtain that 

Q{r)M^jdiam{q-\a)y+'- ^ inf{ / \x - h\' M^ jd\{x) : & e M} 



< / |a; — a\^dii{x) 



< mi{ [ \x-b\''M^jd\ix):beR} 

= g(r)Af£,diam(g-i(a))i+^ (44) 
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Thus a ^Q € Qn^iO') C / exists, such that 

/ \x-a\^df^{x)^Q{r)h{ia)diam{q-\a)y+\ (45) 

From (j44|) we deduce that 

ni{n) ■ min{diani(q~^(6)) : b £ Jn,i} < diam(r„ /) 

< ni{ri) ■ niax{diani(q~^(&)) : b £ Jn,i} 

< n{{n) ■ f —2^ j niin{diam(q,7^(6)) : b £ J„j} 

< (^^j diam(T„,,), (46) 

where the last inequahty foUows from the first one. According to ([5^ and 
definition (I5T]) choose rio G N such that 



diani(/)/2 < diam(r„,/) < diani(/) 
for every n > ?io- Hence, the setting 

/ »,/- \ 1/(1+'-) / A f \ 1/(1 + '-) 

Ao^(^) diamd), i?o=(^) dianr(/)/2 



and relation (j46|) finishes the proof of this step. 

4. We will prove (p4)) . 

Let us denote by k/ the modulus of continuity of h restricted to /, i.e. 

Ki{w) = sup{|/i(x) - h{y)\ ■■x.y £ I,\x -y\< w}. 

Applying (H5|) and Step 3 we deduce for every n > rip that 

max{| / |a; — a\^dii{x) — diam{q^^ (a))^^'^' h{a)Q {r)\ : a & Jn i} 

< (5(r)max{K/(diam(g~-^(a)))diam(g~-^(a))^+'" : a e J„j} 

< Qir)Ki{Ao{n{{n))-'){Ao{ni{n))-'y+\ (47) 



Clearly, according to (|38|) we know that 

D{ii, Qn, r)/n — > as n — J> oo. (48) 

This implies that 

n((n) — i> oo as n — > oo. (49) 

Indeed, if we assume the contrary, then we can find a sequence (««)?!£» with 
Vn 6 Jnj such that 

\x - u„rdM > Q{r)Mi I liminfdiam(g-i(w„ ))!+'■ > 0, 
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which miplies accordmg to property (G4) of a Gersho quantizer that 

limini D{^,qn,r)/n > 0, 

n—^oo 

a contradiction to (|48l) . Thus, (|49l) imphes together with (j47|) and the definition 
of e2{n) that (n{(n))-'^+''e2(n) — ;> as n — J> cxd. 

5. We will prove ([SS]) and (|36l). 

For every a S J„_/ a Tq € (7,7^ ('^) exists, such that 

;ji/(i+'-)rfA - diam(9-i (a))/i(a)i/(i+'') | 

= \h{Tay/^'+'^^ - /i(a)i/(i+'-)|diam(g-i(a)). 

If we denote by w/ the modulus of continuity of /ii/(i+'") restricted to /, then 
step 3 yields for every n > uq that 

£3(71) = max{| / /ii/(i+'')dA-diam(g-i(a))/i(a)i/(i+''^| :aG J„/} 

At' (a) 

< c.,(Ao(«(H)-')Ao(n((n))-i. 

Because ft,i/(i+'') is uniformly continuous on / we have n{(n)e3(7i) — > as n — >■ 
cx). Moreover, (p6| follows immediately from step 3. 

6. We will prove ([33l) . 

Let n > no and a,h ^ Jnj and let ^a G '7n"'^('^) ^^^d ^t G Qn^i^) according to 
(|45|) . As specified in step 5 let Ta € g7"^(a) and u S g^^(&) such that 

/i(ra)'/^'+''Miam(g-i(a)) = / /^i/^i+'-^dA 

and 



C,d £ Jn,I 



We define 



f{n) — max ■ 



h{r^)\"^'^^^ fh[^,)\"^'^^\^ 



From p8)) we obtain by the same argumentation as for (l49l) that 

sup{diam(g^ (c)) : c G Jn./} ^0 as n ^ 00. 
But this implies that f{n) — > as n — > 00. Now we calculate 

h{Taf'^^+^^ diam(g,;i(a)) - h{nY'^^+^^ diam(g-i(6))| 
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Let us assume w.l.o.g. that 

/i(ra)^/(^+'-Miam(g-i(a)) > hin)'/^'+-^ dmm{q-\b)). 
Thus we obtain from property (G4), relation (|45|) and step 3 that 

= h{Taf'^^+'-^ diam(g-i(a)) - /i(Tb)i/(i+'-) diam(g,-i(6)) 

/htc W 1/(1+'-) 
= /,(r,)V(i+0diam(g-i(6))(^j|^j 

-/i(rb)i/(i+'-)diam(g-i(&)) 

< A,^Mlf+^^f{n). (50) 

n\[n) 

Now we define for every c £ J„_/ 

_ J<;„ (c) 





L /ii/(i+'-)dA ■ 

Jin,/ 




Applying p)|) i 


Are get 






'n(H ^"" -fni/^^ ^"^' 




< 


1 V \LHa)h"''^''d^-L\c)h-"'^'''d>^\ 






-iHcit, /t„,'^^/^^+'^^'^^ 




< 




(51) 


Now. ()51l) and 


(1321) imply P3P and the proof is finished. 


D 



Recall Q{r) = 2 ^(1 + r) i and 5(/i) as the interior of supp(/i). 

Lemma 3.9. Let fj, be weakly unimodal and {q.n)nefi the sequence of n~level 
Gersho quantizers for fi. Assume that I C S{fi). Then, 



^(W y / \x-a\'-d^i{x)^Q{r)( [ h^/^^+'''>dx) 



l+r 



as n —?► oo. 
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Proof. We deduce from ([M|) and the definition of £3 (n) that 
limsup ni{nY y. / \x — a\^ dfi{x) 

< limsnp n{{nY in{{n)e2{n) + ^ diam(q^^(a))^+'~/i(a)(3(r) 

\ a£Jn,l 

— hnisupQ(r)n((n)'' yj diani(g^^(a))^+''/i(a) 

/ \ 1+r- 

< hnisupQ(r)n((n)'^ ^ ( / /i^/^i+'^^dA + EgH ) ■ (52) 



The definitions 



Va — I h^'^^^''''dX, mo = minjwc '■ c d Jn 1} 



imply together with (p6)) that 



1 < hm sup 

n— >oo 

< hm sup 



< hmsup i 



n + £3(nO\l+r\p 1+r 

J2aeJ„,i ^" 

e3(n-) 



A/-^ J min{diam(g„ (a)) : a e Jn.i} J 

with Mi^/ as defined in (|37| . Thus, (|52|) turns together with (p3|) into 

hmsupnj^(n)'' >, / |a; — a|'^(i/i(a;) 

(\ 1+r 

< hmsupQ(r)n((n)'^ ^ (n((n)-i + ei(n))'+'" ( /" h^/^^+''-\ 

= Q(r) hmsup (1 + £i(7i)ri((n))^+'^ ( /^ h^/^^+'-^dx] 
= Q{r)(Jh'/^^+^^dx) 



1+r 
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By similar arguments we obtain on the other hand that 



hminf n((n)'' V / \x - al'^dnix) > Q{r) ( f h^/'^^+^'UX 



which yields the assertion. D 

Theorem 3.10. Let fi be weakly unimodal and (q,i)„gN ihe sequence of n^level 
Gersho quantizers for fj,. If Co < cxd, then {qn)n£N is asymptotically optimal. 

Proof. Let rt G N and 

xi{n) = supg^^(min9„(M)), X2{n) = inf (7,,7^(maxg„(M)). 

Recall (cf. psp ) that D{iJ,,qn,r) < D{pi,qi,r). As a consequence we obtain that 

max{ / \x — mm qn{M.)\^ dfi{x) , / |x — niaxg„(M)|'''d/i(a::)} 

^ ( — 00,2:1 (n)) *^ (2:2 (^):C)o) 

= n^^D{fi,qn,r) < n^^D{ii,qi,r) ^ as n — ;> 00. 

Thus, Lemma [2.11 implies that 

a:i(n) — !> inf(supp(/i)) and X2(7t.) — ;> sup(supp(/^)) as n — > 00. 

Now choose uq > 6 such that /i(/o) > with 

Iq = [xi{no),X2ino)] C supp(^). 

Now let n > no and define k{n) G {0, 1, ... } such that 

no2'=(") <n< no2'^(")+i. (53) 

Recall definition ([28]). By the definition of /q we obtain n2°{nQ) = 2. Due to 
the uniqueness of g„ (cf . Proposition 12. 5p we get inductively that 

n^»(no2'=(")) = 2'=(")+i resp. n^''(no2'=^(")+i) = 2'=(")+2. 

Now, (|55|) and Lemma 15771 fa) imply 

2fc(")+i <„^<'(„) <2'=(")+2, 

yielding 

n^°(n) 2'=(")+2 _ 4 

n ~ no2'^(") no 

Thus we deduce from definition (1281) and (I5T]) that 



n n 1 1 , ,, 

1 < —T < -T < z 9- < TT- (54 

- ri[«{n)-n-n[-{n)-2-l-^^-l-\~l 
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Applying (G4) we get 

n 
= (^) '("!")'■ E / \^~ard^,ix). (55) 

Now, ([M]) . ([551) and Lemma 15^ are yielding 

limsupn'-i^(M,g„,r)< (-^) Q{r) ( f h'/^'+^^dx) . (56) 

By the same arguments we also deduce 

l+r 



limini n''D{^,qn,r) > Q{r) ( f /i^/^^+'^^dA ) 
"^°° \Jia J 



(57) 



Because the choice of no > 6 was arbitrary, the assertion follows from ([56l) and 

4 Concluding remarks 



Remark 4.1. Although condition \20jl in Theorem \3.1\ cannot he dropped com- 
pletely (cf. jKK Example 6.4]), it can be weakened into Cq < oo for one- 
dimensional weakly unimodal distributions in view of Theorem \3.1U[ Indeed, 
1126]) is only needed to prove in Theorem \3.1\ that n^Dn.rip-) is upper-bounded by 
Co, but this follows from Theorem \3.10\ if fi is weakly unimodal and Cq < oo. 

Remark 4.2. It seems that Theorem ] 3. 10\ is also valid if the density h consists of 
a finite linear combination of weakly unimodal densities. Nevertheless it remains 
open, if Gersho quantizers are asymptotically optimal for arbitrary densities with 
finite r—th moment and Cq < oo. Moreover, it would be interesting to know if 
Theorem \3.10\ remains valid for those distributions whose Gersho quantizers are 
unique. 

Remark 4.3. The methods of this paper are strictly confined to the one- dimensional 
case. To find answers regarding the existence, construction and asymptotic opti- 
mality of Gersho quantizers in higher dimensions further research is necessary. 

Remark 4.4. For dyadic homogeneous one- dimensional Cantor distributions 
IB [MU^ it is known that 

< C_ = Imimf n^ Dn^rip-) < lim sup n'"-D„.,(/i) = C < cx3. 

It is easy to check for these measures that for n — 2^ a unique optimal quantizer 
qk exists, these quantizers are also Gersho quantizers, and that 2^"^ D2k ^.{ii) 
tends to C_. Hence, 

C_ = liminf n*^ inf{Z?(/i, g,r) : g G Q{n, M,?')} (58) 
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and by definition 

C < linisupn'"inf{I?(/i, q,r) : g G Q{n, ^, r)}. (59) 



It remains open, if !159\) is also an equation or not. Moreover, there exist dis- 
tributions Jllf which are non-atomic and singular to the Lebesgue measure but 
C_= C . It remains also open, if \5l^] is also valid for these distributions or if 
even h59j) turns into an equation for such measures. 



Remark 4.5. Let I <Z M. be a compact interval and let qn be a quantizer with 
n codepoints. Recall definitions \31\) . If {qn)n&i is asymptotically optimal for 
II = hX and i26\} is satisfied, then Bucklew J^ has shown that 

n((n) Lh'^dX .^^ 

-^^-^ -^ ^ 1 asn^oo. (60) 

Hence, Remark iS. 2\) and Theorem \3.10\ implies that \6(^) holds also for Gersho 
quantizers if fx is weakly unimodal and satisfies i26\) . Beside of this point den- 
sity result, one is also interested in densities for the error and the mass of the 
codecells. More formally, let 

j^, J X Jj\x-qnix)\'''dfi{x) 

E{n,I,qn) = ^ 

D(n,qn,r} 

and 

M{n,I,qn) = snp{\nii{q-\a)) - h-l^^+^\a) ■ fJh'/^^+^^dx) \ : a e J„,/}. 

By analyzing the approach in 01/ and flSf . it is reasonable to conjecture that 

JjhT^dX 

E[n,I,qn) ^- ^^ — as n -^ CO, (61) 

J^h^+^'dX 

i.e. that error and point density are asymptotically equal for asymptotically op- 
timal quantizers, which would imply that \61\) holds also for Gersho quantizers if 
jjL is weakly unimodal and satisfies I126\) . Finally, due to '5, Theorem 4-J we know 
that M{n, I, qn) -^ Q if h is weakly unimodal and qn is an asymptotically optimal 
stationary Voronoi quantizer. Note that a Voronoi quantizer is stationary if ev- 
ery codecell has non-vanishing pi— mass and (G3) is satisfied. Although, Gersho 
quantizers are no stationary Voronoi quantizers in general, we conjecture that 
M{n,I,qn) -^ still holds for Gersho quantizers if I186\) is satisfied. 

Remark 4.6. As already mentioned in the introduction, Delattre et.al. J^ 
have shown that asymptotically optimal stationary quantizers qn satisfy (G4) 
asymptotically, i.e. 

G{n,I,qn)^sup{\n^+'' [ \x - a]"^ dfi{x) - Co\ : a e Jn i} ^ (62) 
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as n —> oo. Note, that asymptotic optimality does not imply lidS^) . To see this let 
jjL he the uniform distribution on [0, 1], let e & (0? 1) '^'^'^ consider the quantizer 



<fn{x) 



-■hQ^){x) + Y (- + - ^f-^-l^Vl 1-^ 1-^ (a;). 

■i— 1 ^ ^ -^ -^ 



By a straightforward calculation one gets 

n^D{,,, ql,r) - Q{r) le'+^^n-' + ■—— ( 1 + — — ) I ^ Q{r) 



n — 1 / , 1 — £ 



n- 1 



as n — i- oo. Hence, {q'^{x))n&i is asymptotically optimal and satisfies (Gl), 
(G2) and (G3), hut satisfies neither (G4) nor 



Remark 4.7. To the authors knowledge there are no general results available so 
far concerning the rate of convergence in {21^ . Fort and Pages |^ Theorem 5] 
have shown for three special families of scalar distributions (exponential, power 
and inverse power) that 

Tl 

limsup|Co -n'^D{^.,qn,r)\- — -— < oo, (63) 

n^oo log(n) 

*/ ?« € C(n,fj,,r). It remains open, if li6S\) is still true for Gersho quantizers. 
Moreover, it is unclear if Ii63\) is generally true for weakly unimodal densities 
and Gersho quantizers. 

Remark 4.8. Asymptotically optimal quantizers in the scalar case can be con- 
structed by companding techniques \TTj. Alternatively, stationary quantizers - 
which are unique and optimal for strongly unimodal scalar distributions (cf. 
J22j) - can he numerically determined hy the famous Lloyd algorithm 118]. To 
get an overview of the historical development and the numerous modifications of 
the Lloyd algorithm the user is referred to U2}/ . One drawback of all these Lloyd 
methods so far is that at any level n the numerical calculation of the quantizer 
starts from scratch, i.e. the calculation results from lower quantization levels 
can not be used to reduce calculation complexity for level n. Moreover, the limit 
point of the Lloyd algorithm is a stationary quantizer, hut not necessarily an 
optimal one. 

Using the results of this paper, we subsequently can determine numerically a 
sequence of asymptotically optimal quantizers where the calculations from lower 
quantization levels are incorporated. In more detail, assume that fi has a weakly 
unimodal Lebesgue density and let k € N and n — 2^ . For fc = 1 Froposi- 
tion \2.5\ ensures the existence of a unique Gersho quantizer. We can determine 
this quantizer numerically e.g. by a bisection algorithm. If k > 1, then the 
uniqueness of Gersho quantizers (cf. Proposition \2.5]) enables us to determine 
the Gersho quantizer for level n — 2^ by dividing all codecells of the quantizer 
for level 2^^^ into two cells having the some moment, such that (G4) is satis- 
fied. This dispartment of the codecells is also done numerically hy application 
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of a bisection algorithm. Theorem \3.10\ yields the asymptotic optimality of the 
quantizer sequence if Cq < cxd. 

As a main advantage in contrast to any Lloyd algorithm we always determine 
a unique solution for distributions with weakly unimodal densities. Just note 
again (cf. JTj) that more than one stationary quantizer as limit point of the 
Lloyd algorithm can exist for weakly unimodal distributions. Of course, we can 
determine numerically also the Gersho quantizers for level n — n^l^ with fixed 
no > 2 and k € N or even any arbitrary level n. But in this last general case we 
are unable to use the calculation results from lower quantization levels for the 
actual one. 
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